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It is my aim to describe tools, particulary the roof concept, to handle the 
entropy of a subalgebra with respect to a state as defined by Connes, 
Narnhofer, and Thirring ||. How it works is shown in an example. Proofs 
are only sketched. The paper extends common work jTJJ with F. Benatti 
and H. Narnhofer. 

Relying on |3J and J7|, I start repeating definitions. They can live on the 
framework of unital C*-algebras. But I restrict myself, up to isomorphy, to 
finite dimensional ones, i. e. to matrix algebras containing with any matrix 
its hermitian conjugate. For short I call such an object an àlgebra. I use the 
convenient channel terminology [[F]: A ch ann e l consists of two algebras, the 
input one, B, and the output àlgebra A, and a completely positive unital 
mapping a, the channel mapping, from the output to the input system: 
A — > B (unital = identity preserving). The state space of the input àlgebra 
is denoted by Q. A state, u, will be identified with its density operator. 
ió o a is the pullback of the state to the output àlgebra. It is the reduced 
density operator. An ensemble 

S = { Pj ;Uj}, 5^=1, Pk>0 (1) 

of B is a finite set of states together with weights. Performing the convex 
sum 

£ h+ uj ■= Y,PjUj (2) 

we get a new state. We refer to (||) as a convex decomposition of uj or, 
equivalently, as a Gibbsian mixture of the states Uk with coefncients p^. ([[]) 
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and (0) are called short if no coeficient pk is zero and all the Uk are 
mutually different. The length is the number of terms in the short 
decomposition or in the ensemble. 

The mutual entropy of a channel with input ensemble £ reads 

I(£, a) := '^2pjS(ujj o a, u o a) (3) 

S(., .) stands for relative entropy. Like the latter, coarse graining implies 
decreasing of /. Ohya defines the entropy of a channel with respect to a 
state by 

Hu{a) := supl(£, a), £ i— > uj (4) 

e 

The original defmition, |J , appears if at is the inclusion map from a unital 
subalgebra, A, into the input àlgebra. Then, identifying channel and 
subalgebra, one writes H U (A) or H U3 {B\A) for H^a). Monotonicity is 
inherited from (|3]) to (^). Furthermore, H w depends concavely on ou, (see 
below), and it is non-negative. Good reasons to adorn a functional with the 
word " entropy" ! 

Set s(x) = — xlnx. Replacing x by a density operator and performing the 
canonical trace results in the Gibbs-von Neumann entropy, also called S, 



but depending on one argument only. Elementary manipulations show, [11], 



H u (a) = S(u o a) — R(u),a), R := inf y^p ? j5'(a; ? · o a), £ \— > uj (5) 

R is the convex hull of the function u — > S(u o a) on Q, see [Q[. The convex 
hull of any function is a convex function. Thus (|5|) is the sum of two 
concave functions, and H w is concave on Q. 

To calculate the entropy of a reduced density operator is a straightforward 
though often cumbersome task. But to handle R is difficult. An ensemble 
([TJ) is called extremal, iff it consists of pure states only. The set of pure 
states, f2 pure , coincides with the extremal part, íl ex , of the state space, and 
it is compact. Because the entropy functional is concave, it suffices to 
perform the inf in (|5|) with extremal decompositions only. As short 
extremal decomposition is called optimal iff 

H u (a) = I(£,a), R = J2Pj S (Qj)i {Pf Qj} ^ ^ (6) 
and the are pure states. 
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Lemma 1. 

H w and R(u) are continuous on fi. Every lo allows for an optimal 
decomposition (g). One may require that its pure states generate a simplex. 
□ 

R is known on the extreme boundary. It is continuous there. In the real 
space of Hermitian matrices we associate to every pure state g the matrix 
g + R(g)l. The set of these matrices constitutes the compact extreme 
boundary of its convex hull H. The part of 5, visible from fi, is the graph of 
R. Indeed, the smallest real number À satisfying w + Al 6 S equals R(&). 
Now the first two assertions can be seen. The last one follows by 
Caratheodory's theorem. □ 

Lemma 2. Denote by the set of all pure states g in an optimal 
decomposition of u, and by $ w its convex hull. 

(i) R is affine on <& w . 

(ii) If an extremal decomposition of a state u' is based on <£>^ x , it is an 
optimal one. 

(iii) and its convex hull, are compact. □ 



(ii) is a modification of theorem 1 in | ïl| . (i) is equivalent with (ii), and 



(iii) comes from (i) and the continuity of R. □ 

Now I extend the notations. Let F be a function on fi. A set of extremal 
points of fi is called optimal for F iff F is affine on its convex hull. I call F 
a roofii every element u is contained in the convex hull of an optimal set. 
By lemma 2, R is a convex and —R a concave roof. It is an easy exercise to 
show: If two convex roofs coincide on the extreme boundary, they are equal 
one to another. It results: 
Theorem 

The entropy of a channel with respect to a state is uniquely characterized 
as a functional on the state space of the input àlgebra as follows. 

(i) H g (a) = for pure states g. 

(ii) H u (a) is the sum of S(u o a) and of a concave roof. □ 
I add without proof another fact, based on lemma 2. 
Lemma 3. 

Let Hu = 0. Then $ w is the face of u in fi, and every vector belonging to 
the support of u is a common eigenvector for all operators in the output 
àlgebra. □ 

Now I treat two examples to see the roof concept working. In the first, 
known one | LT| , the input àlgebra consists of the 2-by- 2- matrices. The 
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subalgebra of its diagonal matrices is the output àlgebra. From a density 
operator u we need the off-diagonal entry z = Z\i. Assume F{oj) = f(\z\). 
Such a function is convex on íl iff / depends convexly on \z\. Next, the set 
of density operators with fixed z is convexly generated by its pure states. 
Hence, F is certainly a roof. From all that we conclude 



R(u) = s(q) + s(l-q), q := - + -y/ï=ïzï (7) 

Indeed, equality in (|7|) is true for pure states. Being of the form 

R(uú) = f(\z\) it is a roof. It remains to see convexity on \z\ < 1/2. Taylor 

g-expanding (|?p shows convexity term by term: 

R(u) = r 2 (z) := ln 2 - V ( | ~ 4 ^ ( 8 ) 

My next example reads 

B:=Mh-i> *4:=.M n ©.Mi (9) 

There are projection operators, P and Q, in our input àlgebra satisfying 
P + Q — 1, P = such that the reduced density operator and its 

entropy is gained by 

u o a = QujQ + AP, \ = (i/>,wil)) (10) 

S(uo Q ) = S (A) + Trs(QcjQ) (11) 

I like to compute P and to describe <£>^ x . We choose orthonormal 
eigenvectors ipi, . . . , i[) n of QujQ such that 

z k := (ip k ,ujip) > 0, \ k = {^ k ,uip k ) (12) 

Then A^A < z|. Trying to find an ansatz for optimal sets I define 

Zj = (Pj + Pj) z > X j = pj> + + PjVj ( 13 ) 

so that 

gt = z\^ k )(^\ +z\^)(^ k \ +H~\^)(^\ (14) 
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defines pure states. This is possible with 



1 ± l±y^4F 

z = 2^\Zj\<-, V = (15) 

and in that case 

w = £ + í 1 - pí)^7 ( 16 ) 

is an essentially unique extremal convex decomposition of u. We get 

W < «OO + «00 = r a (£ M (17) 
Can the equality sign be true and can (|Ï6|) be optimal? As long 2 < 1/2 is 
fulfilled, (|Ï7|) defines a roof that coincides for pure states with (|TÏ|). (|Ï7|) is 
invariant with respect to unitàries from A, and the set of all QuoQ is a 
unitarily invariant convex set of Hermitian n x n-matrices. Such a 
functional is convex if its restriction to the diagonal matrices in QQQ is 
convex We obtained a convex roof on the considered part of Q. This 
looks hopefully. However, it remains the question, whether the other part, 
z > 1/2, of íl can beat it by bifurcating the roof to another one. 
Appendix : Accessible informatíon 

A channel a is called a communication channel iff the output àlgebra is 
commutative and of finite dimension. Using the expression (|3|) for mutual 
entropy one defines 

I{E) := sup /(£,«) (18) 

CL 

where the sup runs through all communication channels. 
Now let C be a unital commutative *-subalgebra and u a density operator 
of the input àlgebra M. n . C is the linear span of an orthogonal set 
{Qi, . . . , Q r } of projection operators which sum up to the identity. 
Together with u they determinate an ensemble 

£ '■= {Pj, Qj }> Pk = TrQjUJ, pjQj = y/üjQjy/üj (19) 

Within this setting Benatti JÏ2| has shown 

I{£) = H U (C) (20) 

This helps in computing / and in understanding the observed similarities in 
the behaviour of these quite different concepts. See f|, [f|, HÏOf , |T3| . 



Observe that the Holevo bound, 0, can be seen from (|2üD by the 
monotonicity of H^. 

H w {C)<H u {M n ) = S{uü) (21) 
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Abstract: 

After recalling definition, monotonicity, concavity, and continuity of a 
channel's entropy with respect to a state (finite dimensional cases only), I 
introduce the roof property, a convex analytic tool, and show its use in 
treating an example. Full proofs and more examples will appear elsewhere. 
The relation (a la Benatti) to accessible information is mentioned. 
To be published in: Proceedings of the XXI International Colloquium on 
Group Theoretical Methods in Physics, Goslar 1996 
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